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ABSTRACT 

The 1981 guidelines for the California Postsecondary 
Education Commission's program review responsibility are presented, 
along with an overview of the previous guidelines. The commission's 
role is advisory in matters relating to the review of new or existing 
degree programs. The following topics are covered: the legislative 
mandate for the commission's role in the review of degree and 
certificate programs; criteria employed in defining the public 
interest as it relates to academic and occupational programs; six 
major steps in the .annual .program "planning cycle; steps in the 
evaluation of regular segmental reviews of existing programs and 
steps in the encouragement of special intersegmental reviews; and the 
role of the Intersegmental Program Review Council as a forum for 
sharing ideas and observations among its members. Criteria for 
defining the public interest include: student demand, societal needs, 
the number of existing and proposed programs in the field, the total 
program cost, and the maintenance and improvement of quality. The 
"yearly program planning cycle includes segmentalrpreparation of 
5-year program plans and commission staff review of segmental plans. 
Definitions are provided that clarify terms and organizations/staff 
names used in the report, and the appeal procedures is noted. (SW) 
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PREFACE 



The emergence of state-level governing and coordinating boards as 
participants in the determination of higher education policies is a 
relatively recent phenomenon, a majority of these agencies having 
come into existence since I960. (A notable exception, of course, is 
the New York Board ,pf Regents, created in 1784.) Given the diverse 
history and present circumstances of collegiate education in the 
various states, it is not surprising that these state-level agencies 
are far from uniform in structure and function. Despite variations 
in function, however, almost all of them are involved in one way or 
another with the review of academic and occupational programs. 

Approaches to program review are conditioned primarily by whether 
the agency is a regulatory body or merely an advisory body— whether, 
in other words, it. has authority to approve or veto individual 
programs or only to recommend for or against them. The number of 
state-level agencies with regulatory powers in program review has 
grb^ra dramatically since 1960 when only 19 governing and 
coordinating boards had such authority. As of 1978, state-level 
agencies in 39 states had approval or veto authority. 

California, therefore, is among a shrinking minority of states in 
which the state-level coordinating agency remains advisory in 
matters relating to the review of new or existing degree programs. 
As usual, ho wevek, simple comparisons with practices in other states 
are difficult and often misleading because of special circumstances 
in California. FeV' states, for example, have a blueprint which 
delineates the functions of public colleges and universities as 
precisely as does the^Calif ornia Master Plan. No state is comparable 
to California in the size and scope of its public higher education 
enterprise. But perhaps most important, the three public segments of 
higher education in California each operate through a central 
administration which has program review responsibilities. In most 
other states, no similar level of administration separates all the 
public campuses from the statewide governing or coordinating boaj^U 

Recognizing these differences and aware that there were few, if any, 
precedents in other states to be guided by, the Coordinating Council 
for Higher Education in the late 1960s moved to formalize its 
involvement in program review by drawing up guidelines which 
identified goals for the review process and outlined procedure? to be 
followed l>y the Council in its relationship with segmental offices. 
When finally adopted in Marrch 1971, these guidelines provided for 
annual Council review of segmental academic plans and of programs 
outside the "core 11 which had not appeared in the academic plan for 
the previous two years or which required additional staff, equip- 
ment, or funds to initiate. {"Core" programs were those which 
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segmental and Council staff agreed in advance were essential to the 
basic curriculum of a comprehensive campus.) The document did not 
specify what information academic plans or proposals should contain, 
nor what criteria were to be applied by the Coimcil in its review, 
indicating that agreement on these and ot her ess ential details was to 
be reached between Council and segmental staff. J 

The bill establishing the Calif ornia Post secondary Education Commis- 
sion (AB 770, Statutes of 1974) contained explicit references to a 
program review responsibility, making clear, however, that the 
Commission's role was to "review and comment" on programs. An ad hoc 
committee of the new Commission, after hearing testimony from a wide 
range of sources, directed the staff to prepare a statement on 
guidelines and procedures that would incorporate elements of the 
existing review process which the committee deemed important. 

The new guidelines, adopted by the Commission in 1975, borrowed from 
the Coordinating Council's earlier document but shifted its emphasis 
from the review of individual program proposals to the review of 
long-range segmental plans that listed programs projected for two to 
five years hence. The document also established the Intersegmental 
Program Review Council and assigned it a central role in advising the 
Commission on all matters relating to program review^ Finally, the 
1975 guidelines called attention to the importance of campus and 
segmental review of existing programs and attempted to establish a 
framework for monitoring such reviews at the state level. Since that 
time, recognition has grown nationally that insuring rigorous review 
of existing programs is at least as vital a concern for state 
agencies as coordinating the growth of new programs. However, the 
proper role for state agencies, especially advisory bodies, in this 
activity has been especially difficult to define. 

After five year's experience with the 1975 guidelines, it seemed 
timely to reexamine their effectiveness and to review their 
appropriateness to the altered conditions of the 1980s. The 
Commission.; therefore engaged Frank Bowen and Lyman Glenny to 
evaluate state- level program review practices in California. Their 
report, Quality and Accountability : An Evaluation of Statewide 
Program Review Procedures, presented to the Commission in April 
1981, was based on extensive consultation with Commission staff and 
with administrators and faculty committees in all segments. Their 
recommendations tended to endorse the directions outlined in the 
1975 guidelines: (a) they called for greater attention in the review 
process to State and segmeptal master plans, including institutional 
mission statements, and less attention to individual program 
proposals; (b) they encouraged continuing efforts to refine the 
review of existing programs; and (c) they recommended periodic 
intersegmental reviews of selected program areas. Their study 
provided an excellent context for Commission reconsideration of the 
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1975 guidelines and procedures. During mid-1981, several drafts of 
the revised -guidelines were widely reviewed by representatives of 
the segments of California higher education. The present version was 
adopted at the December 1981 meeting of the Commission. 

The goal of all the discussions and of the following document ha*** 
been to contribute to a process that will insure, with economy of 
means, the greatest possible variety of quality higher education 
programs for Calif ornians. 



THE COMMISSION'S ROLE IN THE REVIEW OF 
DEGREE AND CERTIFICATE PROGRAMS 



I. LEGISLATIVE MANDATE ^OR THE COMMISSION'S ROLE 

In establishing the California Postsecondary Education Commission as 
the statewide planning and coordinating agency for postsecondary 
education, the Legislature recognized the review of academic and 
occupational programs as one of the central functions of the 
Commission. Among the agency's other functions and responsibili- 
ties, these relating to program review are designated: 
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It shall require the' governing boards of the segments of 
public postsecondary education to develop and submit to the 
cotmoission institutional and systemwide long-range plans in 
a form determined by the commission after consultation with 
the segments. 

2. it shall prepare a five-year state plan for postsecondary 
education which shall integrate the planning efforts of the 
public segments and other pertinent plans .... in devel- 
oping such plan, the commission shall consider ...(b) the ' 
range and kinds of programs appropriate to each institution 
or system . . . [and] *(g) the educational programs and re- 
sources of private postsecondary institutions .... 

6. It shall review proposals by the public segments for new 
programs and make recommendations regarding such proposals ' 
to the Legislature and the Governor. 

7. It shall, in consultation with the public segments, establish 
a schedule for segmental review of selected educational pro- 
grams, evaluate the program review processes of the segments, 
and report its findings and recommendations to the Governor 
and the Legislature. 

<*■ 

8. It shall serve as a stimulus to the segments and institu- 
tions of postsecondary education by projecting and identi- 
fying societal and 0ucational needs and encouraging adap- 
tability to change^ 

11. It shall periodically review and make recommendations con- 
cerning the need for and availability of postsecondary pro- ° 
grams for adult and continuing education. 

13. It shall maintain and update annually an inventory of all 
off-campus programs and facilities for education, research 
and community services operated by public and private insti- 
tutions of postsecondary education (Education Code : Chap- 
ter 1187, Section 22712). ~~ 
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II. GUIDING PRINCIPLES 



In a system of post secondary education consisting of a diversity of 
institutions offering a wide range of programs and services, the 
review of plant and programs must be guided by a concern for the 
broad public interest* It must encourage programs that will increase 
the knowledge and skills of individual citizens and be accessible to 
everyone [with the ability and desire to benefit from them. It must 
support programs and activities that promise to advance the 
frontiers of knowledge. And it must seek to foster quality within 
each segment and institution, preserving institutional identity, 
initiative, and vitality in the process. 

At the sprite time, it must be alert to possible unnecessary 
duplication of effort, excessive costs, and inefficiencies in the 
allocation of resources. 

As defined in statute, the Commission's role in the review process is 
advisory. The Commission's recommendations will be based on 
criteria which, to varying degrees, should guide the process at all 
levels. While all of the criteria listed below must be taken into 
account, they cannot be assigned fixed weight in determining the need 
for every degree or certificate program. The criteria to be employed 
by the Commission in defining the public interest as it relates to 
academic and occupational programs, not necessarily listed in order 
of importance; are the following: 

1. Student Demand 

Within reasonable limits, students should have the opportunity to 
enroll in programs of study in which they are interested and for 
which they are qualified. Therefore, student demand for programs, 
indicated primarily by current and projected enrollments, is an 
important consideration in determining the need for a program. 

2. Societal Needs 

Postsecondary education institutions bear a responsibility to 
fulfill societal needs for trained manpower and for an informed 
citizenry. Even though projecting manpower needs is far from being 
an exact science, such projections serve as one indication of the 
need for an existing or proposed program. As a general rule, 
employment prospects for graduates constitute a more important 
consideration in those programs oriented toward specialized 
occupational fields; with certificate or associate degree programs, 
the local employment market tends to be more significant than in the 
case of graduate programs where the state and national manpower 
situation assumes more importance. Recognizing the impossibility of 
achieving and maintaining a perfect balance between manpower supply 



and demand in any given career field, it nevertheless is important to 
both society and the individual student that the number of persons 
trained in a field and the, number of job openings remain in 
reasonable balance. 

3. Appropriateness to Institutional and Segmental Mission 

Programs offered by any institution within a given segment must 
comply with the delineation of function for that segment set forth in 
the California Master Plan, as well as with its own statement of 
mission and special emphasis approved by the segmental governing 
body. 

4. The Number of Existing and Proposed Programs in the Field 

An inventory of existing and proposed programs, compiled by the 
Commission staff from the plans of all segments of postsecondary 
education, provides the initial indication of apparent duplication 
or undue proliferation of programs, both within and among the 
segments. The number of programs alone, of course, cannot be 
regarded as an indication of unnecessary duplication. Programs with 
similar titles may have varying objectives; the regional 
distributidn of programs in public institutions is a consideration; 
and the level of instruction is a factor. In general, each program 
should be evaluated in relation to all other programs in the subject 
in order to ascertain if the program under review represents a 
responsible use of public resources. 

5. Total Costs of the Program 

The relative costs of a program, when compared with other programs in 
the same or different program areas, constitute another criterion in 
the program review process. Included in the consideration of costs 
are the number of nqp faculty required and the student/faculty 
ratios; and the equipment, library resources, and facilities 
necessary to conduct the program. For a new program, it is necessary 
to know the source of the funds required for its support, both - 
initially and in the long run. 

6. The Maintenance and Improvement of Quality 

The public interest demands that educational programs at all levels 
be of the highest possible quality. While primary responsibility for 
the quality of programs rests with the institution and the segment , 
the Commission, for its part, is interested in indications that high 
standards have been established for the operation and evaluation of 
the program. In the process, it is necessary to recognize that a 
proper emphasis on quality may require more than a minimal 
expenditure of resources. 
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7. The Advancement of Knowledge 

The program review process should encourage the growth^ and 
development of creative scholarship . When the advancement of 
knowledge seems to require the continuation of existing programs or 
the establishment of programs in new disciplines or in new 
combinations of existing disciplines, such considerations as costs, 
student demand,' or employment opportunities may become secondary. 



III. DEFINITIONS 
Program 

An academic or occupational program is a series of courses arranged 
in a sequence leading to a degree or certificate. 

Program Plan 

An academic or occupational program plan contains at least an 
inventory of the programs offered or projected by the campuses within 
a segment or by a group of independent or private institutions, 
including a proposed timetable for the implementation of projected 
programs . A plan should also indicate any special curricular 
emphases approved for individual" campuses, and may also contain 
narrative descriptions of problem areas, program trends, future 
needs, and other matters relating to academic planning. In general, 
academic plans are prepared for five-year periods an&^revised and 
updated annually. 

Program Proposal 

A program proposal is a document prepared by a campus describing and 
justifying the need for a degree or certificate program it wishes to 
establish. 

Research Center or Organized Research Unit 

k 

A research center or organized research unit is a formal organization 
created to manage a number of research efforts within a university or 
segment. 

Intersegmental Program Review Council 

The Intersegmental Program Review Council is an advisory body whose 
"function is to assist the staff of the Commission in coordination and 
review of academic plans and programs. The Council will consist of 
designated representatives from the office of the President of the 



University of California, the office of the Chancellor of the State 
University and Colleges, the office of the Chancellor of the 
California Community Colleges, the Ca^f^niaP^stsecondary 
Education Commissi^*, and of a representatT^e^4€5ignated by the 
Association of Independent California Colleges and Universities. 
The Council will also consult, on appropriate issues, with 
representatives from the State Department of Education, the 
Commission on Teacher Preparation and Licensure, the Council for 
Private Postsecondary Education, and the California Advisory Council 
on Vocational Education. 

Segmental Staff 

Segmental staff refers to the designated representatives of the 
chief executive officers of the segments. 

Commission Staff 

Comqiission staff refers to the designated representatives of the 
Director of the Commission. 



IV. COMMISSION REVIEW OF PROGRAM PLANS 

Commission staff will participate in the annual program planning 
cycle with each of the public segments and will prepare an annually 
revised State Program Plan. The six major steps in this yearly cycle 
are outlined below. 



Step One: Segmental Preparation of Five-year Program Plans 

■ •"• ^ / 

By July 1 each year, segmental offices will prepare a five-year 
academic and occupational program master plan for their segment and 
submit a copy of this plan to the Commission staff. This master plan 
should contain a systemwide inventory of existing graduate and 
undergraduate degree and certificate programs and organized research 
units, along with a list of projected degree or certificate programs 
and research centers planned for establishment during the next five 
years. The list should be accompanied by a brief statement (roughly 
one page) for each projected program containing a description of the 
program and the reasons for proposing it, the relationship of the 
program to existing programs and to the mission of the campus, its 
new staff and facilities requirements, and the possible date for the 
program's initiation. 

In addition, this segmental program master plan should indicate what 
existing programs on each campus are scheduled for review during each 



of the next two years. It should also identify campuses that have 
been designated as centers for the special development of certain 
curricular areas, comment on fields of study in which supply and 
demand imbalances, may be developing, and discuss any other issues 
related to program review the Segment chooses to single out for 
attention. 

Step Two: Commission Staff Review of Segmental Plans 

By August 15, the Commission staff will integrate the segmental plans 
and prepare a draft of a five-year State Program Plan, identifying 
potential problem areas. In its review and integration of segmental 
plans Commission staff will take into account the criteria of need 
•listed on pp. 2-4 above and will be alert to other issues arising 
perspe a c n tive aminatl0n ° f Se8mental P lans frQm * n intersegmental' 

Step Three: Intersegmental Review of Draft State Program Plan 

By October 1, the Intersegmental Program Review Council will meet to 
refine the State Program Plan and attempt resolution of issues. The 
Council will consider possible conflict? among the academic master 
plans of the segments, review Commission staff recommendations, and 
advise Commission staff on other matters relating to the preparation 
of the State Program Plan, including needed manpower and related 
curricular studies which should be undertaken by the Commission. 



~Step Four: commission Staff Revision of Draft Plan , 

By December 15, in consultation with the Council, Commission staff 
will prepare a revised draft of the State Program Plani including 
issues that the Council was unable to resolve, for presentation ?o 
tne Commission for its review and consideration. 

Step Five: Commission Action on Plan 

!L«! nU !! r Z L fu' aftC 5 disc "ssion and possible amendment of the plan 
SfJEi ? the staff, the Commission will adopt the final version of 
the State Program Plan and submit it to the Governor and Legislature 

Step Six: Segmental Revision of Five- Year Program Plans 

Finally, the segments should consider, revising their five-year 
program plans in harmony with recommendations in the State Program 
Plan as adopted by the Commission. 
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1f t COMMISSION REVIEW OF PROGRAM PROPOSALS 

I* ft cartful screwing of projected programs listed in the segmental 
ftMifM Mtttr plans, Commission staff expects to. reduce the number 
f| 4*Ull*4 propoaala for individual programs it reviews 
iltMiiVCly* If the Commission staff has not challenged a projected 
ft*aftf*< ippaaring in a segmental master plan for at least two years 
iggitdiatftly prior to its intended implementation date, concurrence 
Commission staff is to be assumed. If a proposed program has not 
tppaarad in the segmental master plan, or if the need for the program 
kai baan questioned by Commission staff in the State Program Plan, 
Comiaaion ataff will review the proposal as follows: 

fltap Ond: Segmental Preparation of Program Proposal 

Segmental offices will submit information in a mutually agreeable 
font about proposed programs to the Commission staff for review. All 
proposals for programs to be initiated in the fall term should be 
submitted to the Commission staff before March 15. The deadline for 
proposala for programs scheduled to begin in the winter or spring 
tan is October 15. 

Segmental staff will also notify the Commission of their approval of 
program changes that do not require Commission staff review (such as 
proposed programs that have been projected in the segment's program 
plan for at least two years, changes in name, options, or areas of 
concentration within a program) by forwarding a brief description of 
tha approved change to the Commission staff for its information. 



:aff Step Two: Commission Staff Review of Proposal 

Commission staff will review the proposal in accordance with the 
criteria stated on pp. 2-4 above. If the staff does not comment on 
the proposal within 6G days after it is received, concurrence with 
the segmental recommendation for approval is to be assumed. The 
Commission staff will direct questions regarding the proposal to the 
segmental office rather than to the campus or program staff directly 
involved, or will consult the segmental office before communicating 
with a campus. 
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Step Three: Segmental Review of Commission Staff Recommendation 

If a segment disagrees with a recommendation from the Commission 
staff regarding a program proposal, either party may bring the 
proposal to the Commission for its review and comment. 
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Step Four: Commission Action on Proposals 

iL«r^ da,lCe /* ith itS le 8 iala tive mandate, the Commission will 

SKSor^nTSu iT?!^ Pt T 8ala t0 the ^8i.lature L the 

usu * 11 y j i ? the form of a summary of program review 
activities prepared in November or December of each year 
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should report; (a) what programs and program areas were reviewed; 
(b) what fcind of review was conducted (i.e., regularly scheduled 
review of program or department, standard review of recently 
initiated program, special review of program with problems r review 
of curriculum in preparation for accreditation visit, etc.); (c) who 
conducted the review; (d) what criteria were used to evaluate the 
program (i.e., enrollment and placement records, caliber of staff, 
relation to similar programs on campuses within the segment and in 
other segments, etc.); (e) what were the significant conclusions; 
and (f) what actions resulted from the review (continuation, 
modification, termination, or other). 

the summary report should also list all programs terminated! on each 
campus during the academic year. 

r 

Steps in the Encouragement of Special Intersegmental Review^ 

In addition to reporting on the annual program review activities 
Within the segments, Commission staff, in consultation with, IPRG, 
will recommend a field, or fields , of study to be reviewed 
concurrently by all the segments during the following year. This 
special review is not intended to interfere with or replace any other 
reviews of existing programs routinely carried out by the central 
offices of the public segments or by their individual campuses. 
Indeed, such reviews may supply all information necessary for the 
intersegmental survey. The purpose of the intersegmental review is 
to establish a comprehensive body of information which should lead to 
more informed judgments concerning, curricular issues at all levels 
of planning. . 



The intersegmental review should help answer some of the following 
questions : 

a. Do the degree or certificate programs within the field appear to 
be overproducing or underproducing graduates for the related job 
market? 

b. Do degree or certificate programs within the field represent 
appropriate adherence to the principle of differentiation of 
function? 

c What articulation or career ladder provisions are in effect 
within the program area? 

d. What developments within related occupational fields have 
implications for educational programs? 
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The Commission staff, in consultation with the Council, will select 
the program area or areas to be reviewed. The selection will be 
based on the following considerations: 

a. Significant changes in enrollment over a five-year period; 

b. Uneven regional distribution of programs; k 

c. Large number of projected programs; 

d. Rapidly changing job markets for graduates of programs; and 

e. Special circumstances (request from the Governor or Legislature, 
unusual public interest, review in one segment already planned' 
or other special conditions). 9 

For those program areas selected for review, the Comnission staff 
will request information from each segment in the following 
categories, as appropriate: 

a# < Fiv ^y ear his toz^ ^of enrollments and degrees granted in areas 
under review ; ' 7. " v *' r ' • ' / 

b. Program costs; 

c. Records of placements; and 

d. Institutional comments on relation of program to institutional 
mission, results of recent reviews of program, importance to 
students, and future plans for the program. 

Commission staff will be responsible for integrating the information 
from all the segments, for reviewing developments within the program 
area and rfelated occupational fields/ and for making 
recommendations. In those areas in which an extensive written report 
seems appropriate, the Commission staff will work with a specially 
appointed technical advisory committee in preparing the report or 
consider hiring a consultant to conduct the study. 

VII. STAFF RELATIONSHIPS 

1 . Intersegmental Program Review Council 

In addition to the specific functions identified in this document, 
the Council will serve as the established forijim for the sharing of 
ideas, observations, and concerns among its members. Developments 
related to program review within any segment— for example, plans 
for, or the status of, systemwide reviews of a certain field of 
study— should be reported at IPRC meetings. The Council will 
function in whatever ways seem feasible to identify, discuss, and 
help resolve curricular. iasues-with intersegmental implications - 
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2. General Relationships 

Between meetings of the Intersegmental Program Review Council, 
Commission staff may: 

a. Initiate discussion with any segment on matters of mutual 
interest; 

b. Request information necessary for carrying out the Commission's 
program review responsibilities; 

c. Suggest, where appropriate, cooperative programs involving two 
or more segments; and 

d. Identify and comment on apparent unmet needs in postsecondary 
programs and services. 



VIII. APPEAL PROCEDURE 

Any action or decision resulting from procedures described in this 
document may be appealed to the full Commission by any of the parties 
represented on the Intersegmental Program Review Council. 
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